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DUAL COMPRESSION FORMAT DIGITAL 
VIDEO PRODUCTION SYSTEM 

REFERENCE TO RELATED APPUCATIONS 

This is a continuation-in-part of U.S. appiicatioh Sen No. 
08/298,104, filed Aug. 30, 1994 and U.S. application Ser. 
No. 08/050,861, filed Apr. 21, 1993, now patented, U.S. PaL 
No. 5,450,140. 
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This invention relates generally to video recording sys- 
tems associated with the editing of program materials, and, . 
more particularly, to a system that lakes advantage of a 
PC-based platform for performing non-linear editing func- 15 
tions. 

* BACKGROUND OF THE INVENTION 

Traditional video editing systems are generally divided ^ 
into two categories: linear and non-linear. Linear editing 
systems are generally integrated with tape-based program 
storage, while non -linear editing systems are associated 
more closely with disk-based storage media, wherein ran- 
dom-access storage more easily may be implemented. The 
typical linear editing system is implemented with one of the 
many "broadcast quality" videotape recording formats. The 
choices for analog recorders include, among others, 1" 
. C-format, Betacam. Betacam-SP. U-matic, U-matic-SP, 

O SrVHS, arid Hi-8. The choices for digital recorders include, 

Sj among others, D-1, D-2, D-3, D-5. DCT, and Digital Beta- 

cam. Each of these recording formats is incompatible with 
^ any other format, and all require sophisticated system facili- 

ties, including synchronization systems, edit controllers, 
B audio and video switchers and processors, digital video 

Q effects (DYE) systems, character generators, and other 

^ I equipment. This, in turn, requires extensive physical plant 

^ facilities for electric power, air conditioning and air filtra- 

^ tion, storage space, and maintenance equipment Further- 

fff more, large operational and maintenance staffs are required ^ 

f^. to keep the equipment in good working order. However, 

j , recording duration capacity for these types of videotape 

r~ recorders ranges up to three hours of more, making them 

uniquely valuable for many applications, such as program 
distribution, archival storage, and as master program sources 
for mass duplication of videos for the home video market 
In contrast, non-linear systems are based on optical discs, 
or alternatively, on magnetic or magneto-optical disks. 
Because of the relatively high cost of these storage media 
when long-duration recording periods are required, such 50 
systems are relegated to use as off-line editing systems 
applied to the preparation of edit decision lists (EDLs) for 
use in edit suites incorporating linear editing systems. How- 
ever, the rapid random-access features and editing ease are 
valuable for short programs. * 55 

As currently implemented by many manufacturers (such 
as AVID and videoCube), PC-based hard disk storage is very 
expensive. If equipped with 10 GB of storage capacity, the 
system, in practice, is utilized in a two-step process. First, 
the original unedited program material is digitized at a high 60 
data-compression ratio to provide representative pictures for 
use in an off-line editing environment, whereby the operator 
may develop an EDL. This EDL then is used to perform the 
required editing, using program materials that have been 
digitized and stored at much lower data-compression ratios. 65 
Because these two digitizing steps must be performed in real 
time, this is an expensive, time-consuming process which 
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requires wcll-irained and expensive operational and engi- 
neering personnel. 

SUMMARY OF THE INVENTION 

5 

It is an object of the invention to integrate the most 
valuable features of linear and non-linear editing system 
approaches. 

It is another object of the invention to provide capabilities 

10 for automatic unattended editing from edit decision lists 
developed on an off-line editing system. 

It is yet another object of the invention to provide a 
PC-based digital video recorder for applications such as 
broadcast television playback, video duplication source- 

15 master playback, or other related applications. 

A further object of the invention is to provide extended 
playback of 40 hours or more of digital video programming, 
for cable television or other uses. 

2Q . The present invention achieves these and other objectives 
by providing a PC-based audio/video production system 
which addresses the problem of providing inexpensive alter- 
natives to the large, expensive edit suites currently in 
conunon use. Digital program source materials, produced by 

25 specially modified cameras or other sources, provide data- 
compressed audio and video program materials in two 
formats having matched edit-time-code identification. A first 
format having a higher data-compression ratio and intended 
for use in an off-line editing system is used to develop an edit 
decision list, and a second format having a lower data- 
compression ratio is used in an on-line editin'g system for the 
production of a final representation of the program. As such, 
off-line editing decisions may be developed on a PC, includ- 
ing a portable PC, using removable storage media, and final 

25 representations of the programs may be implemented on a 
stationary-head or rotary-head digital-tape-based format, 
such as DAT, 6-mm or 8-mm. 

By employing one of several new, small, inexpensive 
storage media such as PCMCIA-based disk drives, and by 

40 utilizing data-compression technology, the off-line editing 
capabilities are achieved in an economical system, with the 
digital-tape-based formats providing broadcast-quality 
required even for demanding applicadons. Recording dura- 
tion capacity for these media is 60 to 120 minutes or longer 

45 for conventional NTSC or PAL video formats, and a natural 
extension to HDTV formats (with comparable program 
duration capacity) is achieved as commercial availability of 
storage m^a having higher recording densities becomes 
economicaDy practical. Where compatibility to filin raate- 

50 rials is desirable, operation of the various system compo- 
nents at 24 frames-per-second is implemented. 

A method of producing a final video program according, to 
the invention therefore includes the steps of providing 
program source materials m first and second digital formats, 

55 the fir^t format being characterized in having a higher data 
compression ratio than the second; recording the materials in 
the first and second formats, respectively, onto first and 
second removable storage media along with correlated edit- 
time-code information in each case; interfacing the first 

60 storage medium to an off-line video editing system to 
develop an edit decision list; interfacing the second storage 
medium to an on-line video editing system; transferring the 
edit decision list developed in conjunction with the off-line 
video editing system to the on-line video editing system; and 

65 editing the materials in the second formal on the second 
storage medium, in accordance with the edit decision list, to 
produce a final video program. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. I is a schematic drawing of a portable dual-format 
digital video recorder optionally implemented as pan of a 
camcorder system; 

FIG. 2 is a functional block diagram of a dual-format 
digital video recorder; 

FIG. 3 is an oblique representation of an off-line digital 
video editing system implemented with a PC-based edit 
controller having provisions for accepting removable sior- lo 
age media; and. 

FIG. 4 is a block diagram of an on-line digital video 
editing system implemented with a PC-based edit controller 
having provisions for accepting removable storage media. 

15 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

FIG. 1 shows a portable dual-format digital video 
recorder according to the invention, optionally implemented 
as part of a camcorder system, A lens 2 and viewfinder 4 are 
mounted on the body of a camera frame. The usual optical- 
splitter, CCD sensors and driver circuitry, and digital signal 
processing circuitry are located at 6, with optional battery- 
pack capability being shown at 10. The various analog and 
digital output signals and any input audio, video, or control 
signals, all shown generally at 16, are interfaced through 
appropriate connectors disposed on the rear-panel 12 and 
sub-panel 14. Provisions are included as shown for the input 
of analog audio signals, and for the output of both analog 
' and digital audio signals. Preferably fiber-optic cabling is 
employed as a signal-carrying mediimi. 

The intemal_ video recording facilities are comprised of 
two parts. First, a lower data-compression-ratio digital 35 
audio/video signal is recorded on a stationary-head or 
rotary-head digital data tape recorder (such as quarter-inch 
cartridge, half-inch cartridge, DAT, 6-mm or 8-nmi) in the - 
removable-tape transport 18, intended for utilization in an 
off-line video editing system, described herein below. 40 
Simultaneously, a second digital audio/video signal having 
a higher data-compression ratio is recorded on a removable 
storage media unit 20. This removable storage medium is 
intended for utilization in an off-line video editing system, 
also described herein below. In practice, this removable 45 
storage medium may be implemented by any of several well 
known technologies, such as magnetic or magneto-optical 
disks, optical discs, or semiconductor memory modules. The 
two signal recording media implemented in the two parts of 
the internal video recording facilities may record the audio 50 
and video signals in separated form, or alternatively may be 
implemented by any of several well-known systems for 
interleaved audio/video data, such as the audio/video inter- 
leave ("AVT') system of Microsoft Corporation, the 
"M-Power'' technique offered by Hewlett-Packard, or other 55 
systems. 

Examples of removable storage media include PCMCIA- 
based removable disk drives (currently available with 
capacities of 420 MBytes, and soon to be available with 
•capacities as high as 1 GByte) and 8-mm. tape cassettes 60 
(currently available with edacity of 20 GB, and soon to be 
available with capacities as high as 80 GB). At a data- 
compression ratio of 50:1, 420 MBytes will store approxi- 
mately 75 minutes of program material (in NTSC formal 
using an image dimension in pixels of 320x240 for off-line 65 
editing), and at a data-compression ratio of 5: 1 , 20 GB also 
will store ^proximately 60 minutes of program material. 



When the newer 50 GB or 80 GB tapes become available, 
these tapes will be capable of storing either four houis of 
programming in NTSC or PAL format, or two hours in an 
HDTV format, making them practical for use in those 
5 applications currently allocated to linear editing equipment, 
. as described above. Alternatively, using the currently avail- 
able MPEG-2 data compression with a rado of 20: 1 , a 20 GB 
tape will accommodate four hours of NTSC or PAL reced- 
ing (or one hour of HDTV); an 80 GB tape will accommo- 
date 1 6 hours of NTSC or PAL recording (or four hours for 
HDTV). Where compatibility to film materials is desirable, 
operation of the various system components at 24 frames- 
per-second is implemented. 

FIG. 2 is a functional diagram of a storage-device-based 
digital recorder according to the invention, either employed 
in a video camera, or implemented separately in editing and 
production facilities. As shown, a removable hard disk drive 
70 and a digital t^e drive 88 are interfaced through an 
interface bus controller 72. Such a system achieves data 
transfer rates of 10 MB/sec, and higher rates on these or 
other data storage devices, such as high-capacity removable 
memory modules, is anticipated In practice, alternative 
methods of storage such as optical or magneto-optical drives 
could be utilized, preferably based on various interface bus 

25 standards such as SCSI-2 or PCMCIA. In all cases, howevec, 
in order to ensure compatibility with downstream editing 
facilities, both of the removable media for drives 70 and 88 
sbould be lecorded with identical or at least correlated 
edit-time-code information, so that edit lists developed from 
one storage mediimi will produce tiie same results when 
applied to the program material recorded simultaneously on 
the other storage medium. 

Microprocessor 74, through user interface provisions 75 
(such as keyboards, touch-screens, etc.) controls the 64-bit 

35 or wider data btis 80, which integrates the various compo- 
nents. C^urrently available microprocessors include . the 
Alpha 21064 by Digital Equipment Corporation, and die 
MIPS R4400 by MIPS Technologies, Inc. Fumre implenm- 
tations might rely on the already announced P6 by Intel 

^ Corp. or the PowerPC 620. An alternative architecture may 
be implemented using multiple processors working in par- 
allel to increase the effective frame rate. The PQ dflta bus, 
for example, is capable of sustained data transfer Tates of 
100 MB/sec. A ROM 76 is used for "fixed program storage. 

45 The RAM 78 preferably has the capacity to function as a 
buffer, Tepresentiog 25 seconds or more of live NTSC video 
in 4:2:2 format, to enable "hot-swiping" of jemovable 
media without interruption of the input video signal during 
recording or alternatively the output video signal during 

^0 playback. Graphics processor 82 represents dedicated hard- 
ware which performs the various manipulations required to 
process input video signals 84 and to output the video 
signals 86. Although shown as Y/R-Y/B-Y format, either the 
inputs or outputs, or both, may be configured in alternative 

55 formats, such as RGB, YIQ, YUV or other conmionly used 
alternatives. 

While a software-based implementation of the data com- , 
pression is possible, a hardware-based implementation is 
preferred, with the system employing, for the tape-based 

60 drives, a data-compression ratio of 5:1 for conventional 
signals (NTSC/PAL) and a 10:1 data-compression ratio for 
HDTV signals. For the hard-disk drive, a data-compression 
ratio of 50:1 is preferably utilized. Examples of the many 
available options for this data compression function include 

65 the currentiy available Apple QuickTmie system, ftaoal 
compression, MPEG-1 (for off-line applications) and 
Motion-JPEG (for on-line applications). In many applica- 
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tions, MPEG-2 data compression will be suitable for on-line 
cdiling. Audio signals may be included within the data 
stream, as proposed in the several systems for digital tele- 
vision transmission already under evaluation by the Federal 
Communications Commission, or by one of the methods 5 
available for integrating audio and video signals used in 
multi-media recording schemes, such as the Microsoft 
".AVr* AudioA^ideo Interleave) file format As an alterna- 
tive, an independent system for recording audio signals may 
be implemented, either by employing separate digiti 
recording provisions controlled by the same system and 
electronics, or by implementing completely separate equip- 
ment external to the camera system described above. 

FIG. 3 shows an off-line digital video editing system, 
implemented with a PC-based edit controller having provi- 
sions for accepting materials in the form of removable 
storage media. The controller 102 is preferably of conven- 
tional design, but operates at least at the level of current Intel 
Pentium or high-level "486" processors. The unit is 
equipped with a color display, and preferably includes a PQ 
internal bus structure, and provisions for interfacing with a 20 
removable PCMCIA storage card 104. In one embodiment 
this card 104 is implemented with magnetic or magneto- 
optical disks, or with an optical disc unit. Alternatively, a 
stand-alone external data storage unit (not shown) could be 
interfaced through the PCMCIA facilities, or by way of an 25 
SCSI-type interface. 

As an optional feature, a PCMCIA expansion adapter 106 
may be provided, so that a plurality of PCMCIA cards or 
PCMCIA devices 108 may be accessed conveniently 
through a single PCMCIA slot on the PC, as shown. This 30 
expansioii adapter is provided with internal selection and 
multiplexing circuitry, so that each plug-in card or device 
may be accessed independently and without interference 
with any other card or device in [he expansion adapter. The 
selection may be performed by employing techniques well- 3^ 
known in the art, such as the addressing schemes utilized for 
SCSI or GPIB data busses. Since a single 420 MByte 
PCMCIA card module is capable of holding 75 minutes of 
progranmiing material with image dimensions in pixels of 
320x240, 4:2:2 sampling and a 50: 1 data compression ratio, ^ 
an expansion adapter equipped with ten PCMCIA slots and 
plug-in cards is capable of providing ten hours of original 
program material, iind this programming capacity is capable 
of being further expanded with other types of PCMCIA- 
compatible devices. As a further option, a custom-designed 
PC could be provided with multiple PCMCIA slots to accept 
a plurality of storage devices without the need for an 
external expansion adapter. 

In operation, the off-line digital video editing system PC 
is used to edit and combine the materials stored on various 50 
data-storage devices, producing an edit decision list which 
then may be utilized by an on-line editing system. The 
availability of multiple storage devices enables Uie operator 
to rehearse and then confirm "A/B-roll" edits with only two 
storage devices, and "A/B/C-roH" edits with three storage 55 
devices. When equipped with expansion provisions or addi- 
tional SCSI-bus devices, the system is capable of controlling 
the various storage devices so as to produce highly compli- 
cated sequences in a convenient amd timely manner. While 
the lower-quality (higher data-compression ratio) program go 
materials are utilized only for determining the edit points 
(edit decision list) for the program, the off-line editing 
system described herein below is capable of producing the 
final edited version of the program with high-quality results 
in accordance with the preferred embodiment . 55 

The versatility of the system may be further enhanced if 
plaiming for the program is begun by providing script and 
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Staging information to the computer in advance of editing, or 
even in advance of filming or taping the original production. 
The script may be provided as a simple text file, or as a 
formatted word processor file, such as used in "WordPer- 
fect*' or "Word for Windows". As an alternative, the file may 
be of a custom format, as is commonly lised by professional 
scriptwriters. This script and staging information is then 
reformatted to include specific commands, such as when to 
switch camera coverage to a particular actor, or the choice 
of a particular camera angle. Further details may now be 
included, such as the ability to identify close-up camera 
coverage, or points at which specific visual special effects 
(such as split-screen views or chroma-keyed backgrounds) 
or sound effects are to be incorporated. The modified script 
file is then used to guide the operator of the off-line editing 
system in making edit decisions to match the program 
materials to the script, to make any modifications to the 
script that are necessitated by the circumstances of the 
taking, or to take advantage of any unforeseen artistic 
opportunities presented by the actual t^5ed materials. 

In addition, it is common practice in broadcast-television 
news studios to use remotely controlled cameras to telecast 
the live programs. These cameras are moimted on motorized 
bases which are capable of moving the cameras to any 
desired position on the stage, within the physical limits 
imposed by the stage itself (such as the length of the camera 
cables or the clearance available for cameras to move 
relative to each other on the stage). The zoom-lenses, pan-tilt 
moimts, and camera electronic control settings are manipu- 
lated through the camera remote-control facilities, which 
may include either separate electronic control panels or 
alternatively computer interfaces with appropriate control 
software, such as the unit described by washino, U.S. PaL 
No. 5.325,202. By coupling the software script materials to 
instructions for control of the camera movements, the czpz- 
bilities of all of these systems may be optimized. The 
modified script file must be prepared before the actual taping 
occurs, however, and should include the physical layout of 
the sets and props for each scene. 
40 The staging information described herein above, is iden- 
tified by special camera-remote-control software, and the 
camera control operator is provided ^th a graphical inter- 
face which depicts the layout of the set and the "blocked** 
positions of the actors and props for a given scene. This 
45 system preferably also includes a user interface (such as a 
touch-screen or ^ -mouse) to enable the camera control 
operator to program the cameras to be in the correct location, 
and to have the correct zoom-lens and pan-tilt positions, to 
capture the scene as desired, as described in co-pendmg 
50 application U.S. Ser. No. 08/050,861. At this time, the 
operator optionally may add information to control auto- 
mated lighting systems, which are well-known in the are of 
the film, video, and stage production. This enhanced version 
of the modified script file is then used to direct camera 
55 actions during the acUial taping of the scenes, and is further 
modified as part of the off-line editing process as the EDL is 
developed, as described above, in accordance with the 
invention. 

An on-line digital video editing system is depicted in 
60 block-diagram form in FIG. 4. The functional operation of 
tht editing system follows that of the digital video editing 
system disclosed in FIG. 2, or in an alternative embodiment, 
may be implemented in a more sophisticated form, as 
described in our co-pending application "Multi-Format 
65 Audio/Video Production System," U.S. application Ser. No. 
08/298,104 filed Aug. 30, 1994. This system is implemented 
with a PC-based edit controller 206 having separate provi- 
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sions for accepting removable storage media. In the pre- 
ferred embodiment, the digital video tapes recorded by the 
system of FIG. 2 are installed in a tape-storage "jukebox*' 
208 for easy access during editing. Such tape cassette 
handling devices are well-known in the an of computer data 5 
storage, and are generally utilized for data back-up appli- 
cations or for archival storage. 

The edits incorporated into the edit decision list are 
utilized to sequence the various digital tapes so as to 
assemble a recording of the desired program inaterials into 
a final finished product, which is then recorded on the 
videotape recorder 202. This video recorder may be imple^ 
mented as any of the commonly used choices for analog 
recorders, including, among others, 1" C-formal, Betacam, 
Betacam-SP, U-matic-SP, and Hi-8. If implemented as a 
digital recorder, the available choices include, among others, 
D-1, D-2, D-3. D-5, DCT, and Digital Betacam. Further- 
more, the final format could be another digital data tape such 
as the type used for program source material or any other 
removable storage media. Since the time-code identification 
numbers on the removable media of the off-line system 
correlate with those utilized in the on-line system, no 
conversion or adaptation of the edit decision list is needed. 
The video monitor 204 is used to manipulate the windows- 
based edit system control software, and to view the program ^ 
materials as the edit process proceeds. This process will be 
essentially automatic, as all of the necessary decisions 
already have been made in the off-line editing process as 
described above. In addition, this is an appropriate time for 
adding digital video effects to the program or to implement 
any special effects included in the program script. 

The invention may be used for other applications limited 
to record/playback, without implementing the full range of 
editing features. For example, in applications such as master 
playback for video duplication, the program master nape 35 
must be played, rewound to the beginning, and then 
restarted, on a repeating cycle. In facilities employing a 
conventional video tape recorder, this represents a great deal 
of physical stress on the program master tape, thereby 
requiring a large number of copies of this master tape when 40 
many production mns are required to complete an order. In 
addition, some production time is lost due to the rewinding 
process itself. In a disk-based application of the system 
disclosed herein, there is no significant deterioration of the 
master program even in repeated usage, and it is possible to 45 
begin playing a program at any point desired, with essen- 
tially no delay due no cueing the p ro gr am media to the 
physical location containing that part of the recorded pro- 
gram. In order to provide the necessary recording time 
duration, additional hard-disk drives would be added to 50 
achieve the required playback duration. Based on an 
MPEG-2 data-compression ratio of 20:1 (with a 4:2:2 
recording system for NTSC signals), two hours of digital , 
video would require approximately 8 GB of disk storage 
capacity. Disk-drives offering capacity of 9 GB are currently 55 
available, and until removable media achieve comparable 
levels, a program would accordingly be loaded into internal 
or external disk-storage units from the required number of 
removable media units. 

The invention may also be employed as a playback unit 60 
for cable television usage or other extended-playing time 
applications. By adding as many "juke-box" units as desired, 
it is a simple matter to extend the playback time capability 
of the system, with each "Juk^-box" providing approxi- 
mately 40 hours of digital video playback. By fully utilizing 65 
the RAM-based audio/video buffering capabilities discussed 
„with reference to FIG. 2, it is possible to supply digital video 
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playback on a continuous basis by changing the tape storage 
cassettes or cartridges '*on-the-fly'* while video playback 
proceeds. If provided with computer- readable identificaiion 
codes on each cassette or cartridge^ the computer. is able to 
locate the "juke-box" and the particular physical storage slot 
containing program materials that previously have be sched- 
uled for playback. Identification and library management 
systems of this type are well-known in the an, and arc in 
conmion usage implemented as "can-machines" employed 
for playback of commercial advertisements or other program 
materials at broadcast stations. In addition, playback at any 
frame rate or television system standard would be available, 
in accordance with our co-pending U.S. apphcation Ser. No. 
.08/298,104 filed Aug. 30, 1994. 

The versatility of the Digital \^deo Production System 
may -be enhanced further, if plaiming for the program is 
begun by providing script and staging information to the 
computer in advance of editing, or eyen in advance of 
filming or taping the original production. Computer software 
having access to the script materials will enable the operaior 
to match the scenes to the recorded video materials quickly, 
thereby speeding the editing process. In addition, it is 
common practice in broadcast-televisionnews studios to use 
remotely-controlled cameras to telecast the live programs. 
By coupling the software script materials to instructions for 
control of the camera movements, the capabilities of all of 
these systems will be optimized. 

Having thus described the system, we claim: 



